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(54) Three-dimensional image compression method 

(57) The present invention provides a system for ef- 
ficiently representing and storing texture data used with 
polygon textures in representing three-dimensional ob- ' 
jects. The system comprises determination of complex^ 
ity of each polygon texture, combining textures of similar 
. complexity into a two-dimensional composite texture im- 
age, and compressing each composite texture image. ■ ; 
In some embodiments of the invention, the composite 
texture image is formed by resampling textures to a se- 
lected two-dimensional triangle, rotating triangles with 
respect to each other and packing the triangles close 
together to form a continuous composite texture image. - 
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Description 

Field of the Invention 

[0001] The invention relates generally to compression 
of three-dimensional images, and more specifically to 
compressed storage of texture data to be mapped onto 
three-dimensional polygon meshes. 

Background of the Invention 
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[0002] As computers have become more powerful 
and their capabilities have been expanded by a growing 
range of hardware peripheral devices and software, use 
of computers to handle complex media has grown rap- 15 
idly. Desktop personal computers are now often capable \ 
of handling streaming audio and video, and of rendering 
three-dimensional images in full motion. Typical appli- 
cations for such functions often include games, but also 
include processing of information for purposes such as 20 
e-commerce, scientific computing, and record storage. 
[0003] Three-dimensional images in particular are 
computationally intensive to render, and so have only 
recently become commonplace on desktop personal 
computers. A three-dimensional image typically com- 25 
prises a mesh of polygons such as triangles which are . 
rendered from the particular perspective of the viewer \ 
and which are then overlaid with a two-dimensional - 
graphic image. The two-dimensional graphic images -' : 
are sometimes referred to as textures/because in many 30 
instances overlaying the images appears to. provide 
both color and texture to the polygons comprising the 
polygon mesh. 

[0004] To render the three-dimensional image, both 
the detailed geometry of the polygon mesh and the tex- 35 
ture overlay data must be created and stored. This 
stored data is then typically conveyed such as by trans- 
mission over a network or by storage on portable media 
such as a CD-ROM to a user, at which point the three- 
dimensional image is rendered and viewed. Because 40 
the data representing large or complex three-dimen- • 
sional images can be relatively large i it is desirable to 
take steps to decrease the size 'of such data to reduce 
the amount of data that must be stored pr transmitted 
via a network connection. . 45 

[0005] But, current data compression methods ad- 
dress only compression of single files of data, such as 
a single file containing a texture image or a single file 
containing, multiple types of data such as texture and 
polygon data. Many common compression methods so 
such as JPEG are most efficient when compressing data 
that is similar throughout or has repeating patterns, 
making compression of an entire texture map of a com- 
plex surface or compression of a texture and polygon 
mesh data in the same file less than optimal. 55 
[0006] Separate compression of a texture for each 
face of the polygon mesh may result in less overall tex- 
ture data being stored than if it were uncompressed, but 



has the disadvantages of resulting in a compressed tex- 
ture file for every polygon face and does not take ad- 
vantage of the likely similarities between various poly- 
gon textures in the rendered three-dimensional object. 
Also, independent compression of the texture applied to • 
each polygon will typically result in compression of a 
very small image that does not have enough data or rep- 
etition within the data to make such compression effi- 
cient. Additionally, each independent file or object in a 
computer typically must use some minimum amount of 
memory and disk space when stored, and each file must 
be loaded and managed independently. Similarly, trans- 
mission of a large number of files oyer a network is.very 
inefficient relative to transmission of the same data com- 
bined into a few files, again because of the protocol data 
and other management heeded to transfer each individ- 
ual file. 

[0007] What is needed is a method of compressing 
data comprising a three-dimensional polygon mesh in a 
manner that provides a reduced overall data size and 
number of files required to represent a three-dimension- 
al image. It is desirable that the compression method be 
designed to take advantage of the ability of many com- 
pression algorithms to optimally compress files compris- 
ing similar or repeating patterns and limit the number of 
independent files produced as a result of the compres- 
sion. • 

Summary of the Invention .-...v. 

[0008] The present invention provides ^ system for ef- - 
ficiently representing and storing texture data used with 
polygon textures in representing three-dimensional ob- 
jects. The system comprises determination of complex- 
ity of each polygon texture, combining textures of similar 
complexity into a two-dimensional composite texture im- 
age, and compressing each composite texture irhage. 
In some embodiments of the invention, the composite 
texture image is formed by resampling textures to a two- 
dimensional right triangle, rotating triangles in 90 degree 
increments with respect to each other to facilitate effi- 
ciently packing the. triangles together to form a continu- 
ous composite texture image. 

Brief Description of the Figures 

[0009] 

Figure 1 shows an exemplary polygon mesh, con- 
sistent with the prior art. 

Figure 2 shows an exemplary texture map, consist- 
ent with the prior art. 

Figure 3 shows the exemplary texture map of Figure 

2 applied to the exemplary polygon mesh of Figure 

1 , consistent with the prior art. 

Figure 4 is a flowchart of a method of performing an 

embodiment of the present invention. 

Figure 5 shows a composite texture image, consist- 
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ent with an embodiment of the present invention. 
Detailed Description 

[0010] in the following detailed description of sample s 
embodiments of the invention, reference is made to the 
accompanying drawings which form a part hereof, and 
in which is shown by way of illustration specific sample , 
embodiments in which the invention may be practiced. 
These embodiments are described in sufficient detail to 10 
enable those skilled in the art to practice the invention, 
and it is to be understood that other embodiments may 
be utilized and that logical, mechanical, electrical, and 
other changes may be made without departing from the 
spirit or scope of the present invention. The following 15 
detailed description is, therefore, not to be taken in a 
limiting sense, and the scope of the invention is defined 
only by the appended claims. 

[0011] The present invention provides a method of 
compressing a three-dimensional texture-mapped pol- 20 
ygon rendered image. The method comprises in one 
embodiment combining textures of similar complexity 
into a single two-dimensional composite texture image 
and compressing each composite texture image. 
[001 2] Figure 1 shows generally at 1 01 a mesh of ad- 25 
joining polygons that form a three-dimensional surface. 
Larger meshes can be devised to approximate any 
three-dimensional object, and are commonly used for 
rendering three-dimensional objects from different per- 
spectives in computer applications. Each polygon com- 
prising part of a polygon mesh, such as polygon 102, is 
typically joined at its edges to other polygons. The ad- 
jacently joined polygons- comprise a part of the three- 
dimensional object, as the adjoining polygons typically 
do not lie in the same plane. In this manner, an arbitrary 
three-dimensional object can be approximated by a 
number of adjoined polygons. The number of polygons 
needed to represent the three-dimensional object de- 
pends both on the complexity of the object and the de- 
sired spatial resolution. 

[001 3] Figure 2 shows generally at 201 a detailed im- 
age applied to the polygon mesh of Figure 1 , to give the 
appearance of a solid object with color and texture. Such 
an image is therefore often referred to as a texture map, 
indicating that the image is mapped onto the polygon 
mesh to provide the appearance of texture. The texture 
map in many embodiments is not a fanciful image such 
as is shown in Figure 2, but is of a color and texture 
designed to give a three-dimensional mesh a realistic 
appearance of an actual object. Examples include a 
woodgrain texture map to give the appearance of a 
wooden object, and an image of hair to give the appear- 
ance of a hairy three-dimensional object. The texture in 
many embodiments varies in color and texture through- 
out the texture map, enabling representation of complex 
and varying three-dimensional objects such as a per- 
son. 

[001 4] Figure 3 illustrates the texture map of Figure 2 
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superimposed on the polygon mesh of Figure 2, with th 
polygon edges highlighted to make them more visible. 
This representation shows how each polygon in the pol- 
ygon mesh of the example shown has a specific portion 
of the texture map laid over it, such that each triangle of 
the polygon mesh has an associated two-dimensional 
triangular portion of the image map applied to it in ren- 
dering the three-dimensional image. The independent 
portions of the texture map applied to each of the poly- 
gons are often called "texels", and are typically stored 
independently in a standard image format. The texels 
are sometimes stored as compressed images, to facili- 
tate faster transfer of the data and to decrease the 
amount of storage consumed by the data. 
[0015] But, the large number of texels required to 
render complex three-dimensional objects often results 
in hundreds to thousands of individual texel files that 
must be independently stored, transmitted, and proc- 
essed to render the object. Additional storage space is 
consumed in many computer storage systems that store . 
data using allocated blocks of storage larger than a sin- 
gle byte, as extra bytes are likely to be required for half 
or more of the hundreds or thousands of individual files. 
For example, in an operating system where texel data 
of arbitrary size is stored in files that are sized in incre-. 
merits of 4k, an average of 2k of wasted space will be 
taken for each of the hundreds or thousands of texels 
stored to render a single object. 

[0016] Similar problems can exist in communicating 
30 large numbers of files, in addition to the protocol require- 
ments necessary to initiate and manage transfer of each . 
individual file. One particular example where this prob- 
lem is especially important is where network congestion, 
slow servers, or other factors cause relatively slow links 
35 within the Internet may prevent a consumer from using 
a site that requires such excessive transfer of individual . 
files. Compression of the individual files may help some- 
what, and is already incorporated where the texels are 
JPEG or otherwise encoded, but can be inefficient on 
40 texel files that have too little data in them to provide sub- 
stantial data redundancy. 

[001 7] To solve the problems associated with multiple 
texel files and texel data that cannot be significantly 
compressed due to lack of redundancies, a novel texel 
45 storage and compression system is presented. The in- 
ventive solution comprises sorting and combining the 
texels into a significantly smaller number of files, and in 
further embodiments modifying the texels in the combi- 
nation process to facilitate even more efficient compres- 
50 sion. 

[001 8] Figure 4 shows a flowchart of one embodiment 
of the invention. In this embodiment, each texel is ana- 
lyzed and the complexity of each texel is characterized. 
Characterization of complexity at 401 comprises in varr 
55 ious embodiments any combination of change of color, 
rate of change of color, resolution, size, degree of rep- 
etition, histogram, color pattern, and other image char- 
acteristics. Texels of like complexity are sorted into 
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groups at 402. It is desirable that the texels in a single 
group have similar colors and patterns so that redun- 
dancies within each group are maximized, and that the 
texels within each group are similar in size, resolution, 
and complexity so that they can be efficiently placed at s 
403 without loss of resolution. 

[0019] ■ At 403, each group of sorted texels is placed 
into a composite texture image. Placing the texels com- 
prises in various embodiments of the invention steps 
such as resampling the texels, sorting the texels by res- 10 
olution, rotating and placing texels to form squares, and 
placing the formed square pairs of texels into the com- 
posite texture image. In some embodiments, texels are 
resampled if needed to force each texel into an isosce- 
les right triangle shape. 15 
[0020] In other embodiments, the texels are further 
sorted by shape and are not resampled into a right tri- 
angle, but are packed into the composite image in their 
original geometry. Such embodiments lose the efficien- 
cies gained with resampling and efficiently packing the 20 
resampled texels, but do not cause the texel distortion 
inherent in the resampling process and so yield margin- 
ally better image clarity. 

[0021]: In further embodiments, the texels. are also 
searched for texels that are essentially duplicates, such 25 
as different texels from an object of a solid color. These 
duplicate textures are removed, and a 'map or data 
record associates the removed textures with the remain- 
ing duplicate texture for use in rendering the object. 
[0022] The composite texture image is then.com- 30 
pressed at 404. In some embodiments, the texture im- 
age is compressed using a lossy compression algorithm 
compression level that is dependent on the complexity 
of the texels within the composite texture image. In such 
lossy compression embodiments, low complexity re- 35 
suits in use of higher compression and high complexity - 
results in use of lower compression to preserve detail 
and resolution. Compression in various embodiments is 
performed using compression schemes such as JPEG, 
GIF, LZW, PNG, or any other type of compression algo- 40 
rithm. 

[0023] The compressed composite texture image is 
then stored in a file at 405, along with map data indicat- 
ing the location and identity of each texel within the im- 
age. In alternate embodiments, the map data is stored 45 
in a file other than with the compressed composite tex- 
ture image. The map achieves its function in some em- 
bodiments by identifying each texel and the vertices of 
each texel in the composite image map, along with the 
corresponding vertices of each texel within the corre- so 
sponding polygon mesh. Such a map can then be used 
to resample and render the texels onto the proper loca- 
tions on the polygon mesh in rendering the object. 
[0024] Figure 5 illustrates an example of a composite 
texture image created from the three-dimensional object 55 
and texture illustrated in Figures 1 -3. The composite tex- 
ture image is composed of texels mapped into right tri- 
angles, and rotated with respect to each other in pairs 



such as texels 501 arid 502 to form squares. The 
squares formed by pairs of texels are then placed im 
proximity to one another to form a continuous composite 
texture image as shown generally in Figure 5. 
[0025] In further embodiments, the texels have jag- 
ged edges 503 when rotated and placed in pairs to form 
squares. The jagged edges in some further embodi- 
ments are 8x8 pixels, which corresponds to the unit area 
upon which the popular JPEG image compression algo- 
rithm operates. The jagged edge is formed in some em- 
bodiments by mapping portions such as 504 of the texel 
501 across the hypotenuse of the texel, the portions 
comprising 8x8 pixel right triangle portions of the texel . 
whose hypotenuses are coincident with the hypotenuse 
of the texel. The portion 504 is then mirrored across the 
hypotenuse to form reflected portion 505, which shares 
both size and content of portion 504. The resulting pair 
of jagged-edged texels such as 501 and 502 will in such 
embodiments have no boundaries between texels with- 
in each 8x8 portion of the composite texture image, al- 
lowing more efficient operation of the JPEG compres- 
sion algorithm and similar methods. Also, elimination of 
portions of multiple texels within each 8x8 image area 
prevents introduction of a color bias or tint from neigh- 
boring texels into compressed image region data. Cop- 
ying the data from portion 504 into reflected portion 505 
also creates a redundancy in data, facilitating efficient 
compression of the 8x8 unit formed by the two portions. 
[0026] In alternate embodiments, the jagged edge is 
formed by sampling additional data from an adjacent 
texel on the. original texture image, but such methods 
are disfavored because they may introduce unwanted 
additional complexity and result in less efficient com- 
pression. In still other embodiments, the reflected por- 
tion 505 may instead comprise an area filled by a solid 
color, reducing the complexity of the resulting 8x8 image 
area. 

[0027] In rendering the object, the reflected portions 
505 or- corresponding image portions utilized to reduce 
complexity within 8x8 areas of the image are discarded, 
and only the original texel data is mapped onto the tri- 
angle mesh. The reflected portions or corresponding 
portions are used only to facilitate efficient and color- 
accurate compression of the composite texture map and 
thereby reduce the storage and bandwidth needed to 
store or transmit the three-dimensional object. 
[0028] It is anticipated that this invention may be suit- 
ably applied to polygon meshes in two' or three dimen- 
sions other than triangle meshes, and will result in sim- 
ilar benefits. This invention further is not limited in scope 
by the examples given here. Although specific embodi- 
ments have been illustrated and described herein, it will 
be appreciated by those of ordinary skill in the art that 
any arrangement which is calculated to achieve the 
same purpose may be substituted for the specific em- 
bodiments shown. This application is intended to cover 
any adaptations or variations of the invention. It is in- 
tended that this invention be limited only by the claims, 
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and the full scope of equivalents thereof. 
[0029] Further, the computer program for carrying out 
the above method can be obtained in electronic form for 
example by downloading the code over a network such 
as the internet. Thus in accordance with another aspect 
of the present invention there is provided an electrical 
signal carrying processor implementable instructions for 
controlling a processor to carry out the method as here- 
inbefore described. 



Claims 

1. A method of compressing a texture map, compris- 
ing: 

determining the complexity of each polygon 
texture from a texture-mapped image; 
combining textures of similar complexity into a 
two-dimensional composite texture image; and 
compressing each composite texture image. 

2. The method of claim 1 , further comprising creating 
a map of each composite texture image, the map 
comprising a polygon mesh location of each poly- 
gon texture present in the composite texture image. 

3. The method of claim 1, further comprising: • 

removing duplicate polygon textures that are 
very similar to an original polygon texture in the 
' same texture-mapped image; and 

mapping the original polygon texture in place 
of the removed duplicate polygon textures. 

4. The method of claim 1 , further comprising determin- 
ing a compression level for each of the composite 
texture images based on the complexity of each 
composite texture image. 

5. The method of claim 1, further comprising determin- 
ing a resolution for each of the composite texture 
images based on the complexity of each composite 
texture image. 

6. The method of claim 1, wherein determining the 
complexity of each polygon texture comprises de- 
termination of the degree of color change between 
pixels in a predetermined area of the polygon tex- 
ture. 

7. The method of claim 1, wherein determining the 
complexity of each polygon texture comprises de- 
termination of the number of times pixel color 
changes in a predetermined area of the polygon 
texture. 

8. The method of claim 1, wherein determining the 



complexity of each polygon texture comprises de- 
termination of edge boundaries within a predeter- 
mined area of the polygon texture. 

5 9. The method of claim 1 , wherein combining textures 
of similar complexity into a two-dimensional com- 
posite texture image comprises resampling each 
texture to a right triangle shape. 

10 1 0. The method of claim 9, wherein combining textures 
of similar complexity further comprises orienting se- 
lected right triangles rotated half a rotation with re- 
spect to each other and placing them in proximity 
with each other within the composite texture image 

15 to form a square. 

11. The method of claim 10, wherein the selected tex- 
tures in a composite texture image are selected by 
size in orienting and placing the selected right trian- 

2Q gles with respect to each other to form a square. 

12. The method of claim 11 , wherein the selected right 
triangles oriented and placed to approximate a 
square comprise right triangles having a jagged hy- 

25 potenuse formed by eight pixel-by-eight pixel 
. square portions of the texture, the edges of the 
square portions oriented parallel to the two sides of 
the right triangle other than the hypotenuse. 

30 13. The method of claim 12, wherein the eight pixel-by- 
eight pixel square portions of the texture forming the • 
jagged hypotenuse comprise a smaller right triangle 
and a reflected image of the smaller right triangle 
joined along their hypotenuses. , 
35 ■ . * 

14. A method of rendering a texture-mapped three di-* 
mensional polygon mesh image, comprising: 

loading polygon textures from a compressed 
40 composite texture image; 

loading map data indicating a polygon mesh lo- 
cation of each polygon texture present in the 
composite texture image; 
rendering a three-dimensional mesh; and 
45 rendering the polygon textures onto the three- 

dimensional mesh locations indicated by the 
map data. 

15. A machine-readable medium with instructions ther- 
50 eon, the instructions when executed operable to 

cause a computer to: 

determine the complexity of each polygon tex- 
ture from a texture-mapped image; 
55 combine textures of similar complexity into a 

two-dimensional composite texture image; and 
compress each composite texture image. 
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16. The machine-readable medium of claim 15, the in- . 
striictions further operable to cause a computer to 
create a map of each composite texture, image, the 
map comprising the mesh location of each polygon 
texture present in the composite texture image. 

17. The machine-readable medium of claim 15, the in- 
structions further operable to cause a computer to: 

remove duplicate polygon textures that are very 
similar to an original polygon texture in the 
same texture-mapped image; and 
map the original polygon texture in place of the 
removed duplicate polygon textures. , 

18. The machine-readable medium of claim 15, the in- 
structions further operable to cause a computer to 
determine a compression level for each of the com- 
posite texture images based on the complexity of 
each composite texture image. 

19. The machine-readable medium of claim 15, the in- 
structions further operable to cause a computer to 
determine a resolution for each of the composite 
texture images based on the complexity of each 
composite texture image. 

20. The machine-readable medium of claim 15, where- 
in determining the complexity of each polygon tex- 
ture comprises determination of the degree of color 
change between pixels in a predetermined area of 
the polygon texture. 

21. The machine-readable medium of claim 15, where- 
in determining the complexity of each polygon tex- 
ture comprises determination of the number of 
times pixel color changes in a predetermined area 
of the polygon texture. 

22. The machine-readable medium of claim 15, where- 
in determining the complexity of each polygon tex- 
ture comprises determination of edge boundaries 
within a predetermined area of the polygon texture. 

23. The machine-readable medium of claim 1 5, where- 
in combining textures of similar complexity into a 
two-dimensional composite texture image compris- 
es resampling each texture to a right triangle shape. 

24. The machine-readable medium of claim 23, where- 
in combining textures of similar complexity further 
comprises orienting selected right triangles rotated 
half a rotation with respect to each other and placing 
them in proximity with each other within the com- 
posite texture image to densely fill the composite 
image. 

25. The machine-readable medium of claim 24, where- 



in the selected textures in a composite texture im- 
age are selected by size in the orienting and placing 
the selected right triangles with respect to each oth- 
er to densely fill the composite image. 

26. The machine-readable medium of claim 24, where- 
in the selected right triangles oriented and placed 
to densely fill the composite image comprise right 
triangles having a jagged hypotenuse formed by 
10 eight pixel-by-eight pixel square portions of the tex- 
ture, the edges of the square portions oriented par- 
allel to the two sides of the right triangle other than 
the hypotenuse. 

is 27. The machine-readable medium of claim 26, where- 
in the eight pixel-by-eight pixel square portions of 
the texture forming the jagged hypotenuse com- 
prise a smaller right triangle and a reflected image 
of the smaller right triangle joined along their hypot- 

20 enuses. 

28. A machine-readable medium with instructions ther- 
eon, the instructions when executed operable ,to 
cause a computer to: 

25 - 

load polygon textures from a compressed com- 
posite texture image; 

load map data indicating the mesh location of 
each polygon texture present in the composite 
30 texture image; 

render a three-dimensional mesh; and 
render the polygon textures onto the three-di- 
mensional mesh locations indicated by the map 
data. 

29. A machine-readable medium having a data struc- 
ture stored thereon, the data structure comprising: 

a first data field containing one or more com- 
40 pressed composite texture images that com- 

prise polygon textures of a three-dimensional 
image; and 

a second field containing map data indicating 
the location of each polygon texture stored in 
4 5 the first data field within the three-dimensional 

image. 

30. The machine-readable medium of claim 29 having 
a data structure stored thereon, the data structure 

so further comprising a third data field containing data 
representing a three-dimensional mesh of polygons 
upon which the polygon textures are rendered. 

31. A method as claimed in any of claims 1 to 14 where- 
55 'in each step of said method is performed by a com- 
puter. 

32. A system for processing data representative of a 
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three dimensional image, comprising means for an- 
alysing the data to determine the complexity of each 
of a set of data elements corresponding to respec- 
tive elements of the image, grouping the data ele- 
ments into groups of similar complexity, and com- 5 
pressing data comprising the combined data ele- 
ments of each group to obtain compressed data 
representative of the image. 

33. An electrical signal carrying processor implementa- 10 
ble instructions for controlling a processor to carry 
out the method of any one of claims 1 to 14. 
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CHARACTERIZE COMPLEXITY OF EACH TEXEL 
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SORT TEXELS INTO GROUPS OF SIMILAR COMPLEXITY 




PLACE SORTED TEXELS IN EACH GROUP 




INTO A COMPOSITE TEXTURE IMAGE 






i 404 


COMPRESS COMPOSfTE TEXTURE IMAGE 
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STORE LOCATION MAP AND COMPRESSED 




COMPOSITE TEXTURE IMAGE IN A FILE 
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